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Description of Reference Numerals 

1... stereoscopic image displaying apparatus, 2L, 2R. . . left- 
eye and right-eye projectors, 3RR to 3 LB. . . three primary color 
deflecting filters, 4... screen, 5,.. glasses, 6L, 6R. . . left eye 
and right eye, 7L., 7R. . . left-eye and right-eye images, 8L, 8R. . . 
the operator's eyes, 9B, 9F. . . imaged images, 11... screen, 12L, 
12R. . . left eye and right eye, 13... imaged object's image, 14L, 
14R. . . left-eye and right-eye images, -21... stereoscopic image 
generation apparatus, 22L, 22R. . . left-eye and right-eye 
processors, 23L, 23R. . . left-eye and right-eye projectors, 24... 
screen, 32... central processing unit (CPU), 33... program memory, 
34... working memory, 35... write-in address generation circuit, 
36L, 36R. . . frame memories, 37L, 37R. . . key signal memories, 38... 
screen address generation circuit, 39L, 39R. . . read-out address 
generation circuit, 40L, 40R. . . video signal interpolation 
circuits, 41L, 41R. . . combiners 42L, 42R. . . key signal 
interpolation circuits, 51... control panel, 61... stereoscopic 
image generation apparatus, 62L, 62R. . . left-eye and right-eye 
processors, 63L, 63R. . . left-eye and right-eye video signal 
recording devices, 64L, 64R. . . left-eye and right-eye switches, 
65L and 65R. . . key signal generation circuits. 
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DESCRIPTION 



Title of the Invention 

STEREOSCOPIC IMAGE GENERATION METHOD AND APPARATUS THEREOF 

Technical Field 

The present invention relates to a stereoscopic image 
generation method and apparatus thereof, which particularly will 
generate a stereoscopic image that the operator can perceive In a 
victual space based on the video signal representing two- 
dimer, s i onal image . 

Background Art 

Hitherto, a stereoscopic image display apparatus as shown in 
Fig. 1 is proposed as a stereoscopic image generation apparatus 
which enables the operator to appreciate stereoscopic images . 

The stereoscopic image display apparatus 1 is constructed so 
as to project left-eye projecting light and right-eye projecting 
light from a left-eye projector 2L and a right-eye projector 2R 
through each read, green, and blue three primary color deflecting 
filters 3LR, 3LG, 3 LB , and 3RR, 3RG, 3RB on a screen 4 to display 
color composite image on the screen 4 , so that the operator can 
see the color composite image through glasses 5 having a left-eye 
filter 5L and a right-eye filter 5R. 

In this case, the operator sees the left-eye image out of the 
color composite image projected from the left-eye projector 2L 
through the left-eye filter 5L, and also sees the right-eye image 
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projected from the right-eye projector 2R through the right-eye 
filter 5R. As a result, as shown in Figs. 2(A) to 2(C), the 
operator perceives the color composite image on the screen 4 as a 
stereoscopic image based on visual difference between a left eye 
6L and a right eye 6R. 

Incidentally, as shown in Fig. 2(A), when a left-eye image 7L 
projected from the left-eye projector 2L and a right-eye image 7R 
projected from the right-eye projector 2R are displayed on the 
same position on the screen 4, 8L, the operator's left eye 6L, is 
crossed with 8R, the operator's right eye 6R, at the same point on 
the screen 4, so that the operator recognizes as if "there is a 
composite stereoscopic image on the screen 4." 

On the contrary, as shown in Fig. 2(B), vrhen the left-eye 
image 7L and the right-eye image 7R are displayed shifting with 
each other at the position opposite to the left eye 6L and the 
right eye 6R on the screen 4, a virtual image 9B is imaged at the 
point in the virtual space (it is generated backward than the 
screen 4) in which the operator's eye 8L seeing the left-eye image 
7L by the his/her left eye 6L and the operator's eye 8R seeing the 
right-eye image 7R by the his/her right eye 6R are crossed. This 
makes the operator to recognize as if "there is a composite 
stereoscopic image backward the screen 4." 

Further, as shown in Fig. 2(C), when the right-eye image 7R 
and the left-eye image 7L are projected at the position on the 
screen 4 opposite to the left eye 6L and the right eye 6R, the 
operator's eye 8L seeing the left-eye image 7L by the left eye 6L 
and the operator's eye 8R seeing the right-eye image 7R by the 
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right eye 6R are crossed at the forward position than the screen 4 
in the virtual space, and a virtual image 9F is imaged. This makes 
the operator recognize as if "there is a composite stereoscopic 
image in front of the screen." 

Consequently, since the projecting points of the left-eye 
image 7L and the right-eye image 7R on the screen 4 can be shifted 
by the distance corresponding to the visual difference between the 
left eye 6L and the right eye 6R, the operator can appreciate the 
composite stereoscopic image as if it were displayed at the 
position of the screen 4, or backward or front in the screen 4. 

When generating a stereoscopic image by way of such method, 
however, it is very difficult actually to decide the projecting 
posiUo^r of the left -eye image 7L and the right- eye image 7R 
projected from the left-eye projector 2L and the right-eye 
projector 2R, which requires the operator well enough skill. 

Incidentally, visual difference between the left eye 6L and 
the right eye 6R is actually not so large (3.25 [cm] and the like), 
so that actual generation of effective stereoscopic image requires 
the complicated setting operation that the skilled operator sets 
the projecting point of the left-eye image 7L and the right-eye 
image 7R by changing with trials and errors. 

Disclosure of the Invention 

The present invention has been made in view of the 
aforementioned points and proposes a stereoscopic image generation 
method and apparatus thereof which is capable of easily displaying 
the composite stereoscopic image of the left-eye image and the 
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right-eye image at desirable position on the screen as needed. 

To solve the aforementioned problems, in the present 
invention, processes source video signal with the image conversion 
process by way of left-eye image conversion process means and 
right-eye image conversion process means, so that the left-eye 
image and the right-eye image can be generated at the desired 
position on the screen corresponding to the visual difference. 

In order to obtain the left-eye image, the image conversion 
arithmetic operation for generating left-eye stereoscopic video 
signal from the source video signal is executed based on a spatial 
image conversion matrix for converting the image represented by 
the source video signal to a virtual spatial position and a left- 
eye perspective conversion matrix for having a converted image 
represented by a conversion video signal converted to the virtual 
spatial position seen through. Further, in order to obtain the 
right-eye image, the image conversion arithmetic operation for 
generating right-eye stereoscopic video signal from the source 
video signal is executed based on the spatial image conversion 
matrix and a right-eye perspective conversion matrix for having a 
converted image represented by a conversion video signal seen 
through . 

Thus, according to the present invention, the left-eye and 
right-eye images can have the appropriate visual difference 
between each other by the parameter that the operator inputs based 
on the input video signal showing a two-dimensional image, so that 
it is possible to generate a stereoscopic image having much finer 
picture quality. 
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Further , according to the present invention, when the 
operator processes the desired three-dimensional process to the 
two-dimensional source video signal , use of the spatial conversion 
matrix and the left-eye perspective conversion matrix and the 
right-eye perspective conversion matrix can generate a left-eye 
and right-eye two-dimensional video signals having appropriate 
visual difference with each other easily by arithmetic operation 
based on the spatial position of the converted source video signal . 

Further, the source video signal is moved continuously by 
frames in the three-dimensional space based on the operator's 
operation, the right-eye video signal and the left-eye video 
signal in real time interlocking with the continuous movement of 
the source video signal . 

Further, the simultaneous image conversion process based on 
one input video signal at the time of generating the left-eye and 
right-eye images removes such complicated process as re- 
synchronization of the left-eye and right-eye images, which makes 
it possible to generate much better stereoscopic image. 
Accordingly, it is possible to display the left-eye video signal 
and the right-eye video signal synchronizing with each other all 
the time on the screen. 

Brief Description of the Drawing 

Fig. 1 is a perspective view showing a stereoscopic image 
display apparatus to which the present invention can be applied. 

Figs. 2(A) to 2(C) are schematic diagrams explaining that the 
operator can perceive a stereoscopic image according to the 
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structure of Fig. 1. 

Fig. 3 is a schematic diagram explaining the left-eye and 
right-eye images to be generated by the present invention. 

Figs. 4 (Al) to (B2) are schematic diagrams explaining the 
movement principle of the stereoscopic image generation apparatus 
and method thereof according to the present invention . 

Fig. 5 is a schematic diagram explaining the image conversion 
process between positional vector on a frame memory and positional 
vector on the screen. 

Fig. 6 is a block diagram showing the first embodiment of the 
stereoscopic image generation apparatus according to the present 
invention . 

Fig. 7 is a block diagram showing the srecona embodiment of 
the stereoscopic image generation apparatus according to the 
present invention. 

Figs. 8(A) and 8(B) are schematic diagrams explaining the 
operation of Fig. 7. 

Best Mode for Carrying Out the Invention 

Referring to the drawings, one embodiment of the present 
invention will be described in detail . 
(1) Generation Principle of the Stereoscopic Image 

A method of generating a stereoscopic image according to the 
present invention is as follows. As shown in Fig. 3, in xyz- 
virtual space including a screen 11, an image conversion 
arithmetic operation is executed so as to obtain left-eye and 
right-eye images 14L and 14R in which the image of an object 13 is 
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seen through on a screen 11 along the directions of left and right 
eyes 12L and 12R when the left eye 12L and the right eye 12R see 
the object 13, a composite stereoscopic image having depth, at an 
arbitrary position. 

Here, the depth means the information representing the 
position in the direction along the centerline passing between the 
left eye 12L and the right eye 12R both watching the object 13. 

As shown in Fig. 4 (Al) , an image VI shown by an input video 
signal as a source video signal (referred to as an object) is set 
as the image displayed at the origin of xy-plane on the display 
screen of the screen 11 on x- and y-axes. 

The object VI, the image of the input video signal input as 
the souics video signal, is processed a. .1 <?1 movement- 

arithmetic operation and a rotary arithmetic operation by a three- 
dimensional image conversion matrix T 0 represented by the following 
equation : 



To = 



m ri2 ri3 0 

r 21 T22 r23 0 

r3i r32 r33 0 

lx ly Ir So 



(!) 



so as to be converted to an intermediate conversion image V2 . 

The conversion process according to the three-dimensional 
image conversion matrix T 0 executes the image conversion arithmetic 
operation on the input video signal with the spatial image 
conversion matrix T 0 , which makes the image of the object VI 
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represented by the input video signal move in parallel in the 
depth direction from the position on the x-y plane along z-axis on 
the screen 11 and rotate- As a result, the input video signal 
converted to the converted image having the depth information at 
backward position of the screen 11. 

The intermediate conversion image V2 is converted for the 
image conversion representing visual difference from the left eye 
12L by + Ax movement matrix L represented by the following 
equation : 



10 0 0 
0 10 0 
0 0 10 
Ax 0 0 1 



Consequently , an intermediate conversion image V3L is 
obtained. 

The + A x movement matrix L means execution of the conversion 
arithmetic operation which moves the intermediate conversion image 

V2 in the direction along x-axis in parallel by the distance of +A 
x. The left eye 12L is therefore assumed to be on z-axis and in 
the condition of seeing the intermediate conversion image V3L from 
its position 12LX. 

Next, the intermediate conversion image VL3 is converted by 
using a see-through matrix P 0 represented by the following 
equation : 
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Po = 



"10 0 0 

0 10 0 

0 0 0 P» 

0 0 0 1 



(3) 



As a result, an intermediate conversion image V4L is obtained 
on the screen 11 on x- and y-axes . 

The conversion process by the see- through matrix P 0 means that, 
when the intermediate conversion image V3L is in the direction 
from the position 12LX of the left eye 12L, the intermediate 
conversion image V4L can be seen by having the see-through image 
of the intermediate conversion image V3L seen through on the 
screen ii. 

Next, the intermediate conversion image V4L is converted by 
-Ax movement matrix IT 1 represented by the following equation: 



i; 1 = 



10 0 0 
0 10 0 
0 0 10 
-Ax 0 0 1 



(4) 



As a result, it is converted to a final conversion image V5L. 

-Ax movement matrix If 1 moves the intermediate image V4L in 
the direction of x-axis in parallel by the distance of -Ax. 
Assuming z-axis to be the center between the left eye 12L and the 
right eye 12R, the position of the left eye 12L is moved by A x 
from the center to left, so that the final conversion image V5L is 
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obtained as the see-through image on the screen 11 (Fig. 4(B1)) 
when the left eye 12L sees the intermediate conversion image V2 
from the original position. 

Since the intermediate conversion image V2 is deep, a left- 
eye image 14L shows a see-through image as the forward part of 
image seems to be bigger and the backward part of image seems to 
become smaller in the direction of depth. 

The conversion parameter rn to r 3 - 3 used in the equation (1) 
rotates the input image VI in the three-dimensional space of x-, 
y-, and z-axes. The parameter l x , l y , and l z moves the input image 
VI in parallel in the direction of x~ , y- , and z-axes. The 
conversion parameter SO enlarges and reduces the input image VI 
two-aimensionally . 

Further, the conversion parameter Ax, -Ax used in the 
equations (2) and (4) moves the intermediate conversion image in 
parallel by the distance +A x and -Ax. 

Further, the conversion parameter P 2 used in the equation (3) 
is a perspective value for applying the perspective for having the 
intermediate conversion image V3L seen through on the screen 11, 
and is set to the value in which the value of the following 
equation: 



is the reference value; it means that the operator's eyes are at 
the position of -16 on the z-axis. 
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The summary of the conversion processes of the left-eye image 
14L shown in Fig. 4 (Al) can be represented by the following 
equations . 

More specifically, noticing a first conversion process step 
for converting the object VI to the intermediate conversion image 
V2 by gain of the left-eye final conversion image V5L based on the 
object VI, the image of the input video signal, and a second 
conversion process step for converting so as to obtain the left- 
eye image 14L, the left-eye conversion matrix T L can be represented 
by the following equation: 

T L = To Pi ... (6) 

which multiplies the conversion matrix T 0 according to the equation 
(1) by the conversion matrix Ti. showing the conversion process 
thereafter . 

Here, the conversion matrix Pj, used at the second conversion 
process step is a perspective conversion rtkatrix as shown in the 
following equation: 

P L = LP 0 L" 1 . • • (7) 

By substituting the equations (2) , (3) , and (4) into the 
equation (7), the following equation: 
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Pl = 



10 0 
0 10 
0 0 1 
Ax 0 0 



10 0 0 

0 10 0 

0 0 0 P. 

0 0 0 1 



10 0 0 
0 10 0 
-P,Ax OOP, 
0 0 0 1 



1 0 0 0 

0 10 0 

0 0 10 

-Ax 0 0 1 



(8) 



can be expressed. 

Here, by stabs ti lu ting the equations (1) and (8) into the 
equation (6) , the left-eye conversion matrix T L can be expressed as 
fox lows - 



Tl = 



rn 


ri2 


ri3 


0 


r2i 


r22 


r23 


0 




rsz 


rs3 


0 


lx 


ly 


1. 


So 



10 0 0 
0 10 0 
P»Ax OOP, 
0 0 0 1 



m — 


ri3P*Ax 


ri2 


0 


ri3Px 


r2i- 


r 23 Pi Ax 


r22 


0 


T23Px 


ri3- 


T33P*AX 


r32 


0 


T33P. 


1* - 


1« PxAx 


ly 


0 


lxPx + So 



(9) 



Incidentally in the conversion matrix T L represented by the 
equation (9) , after the image data is captured in the frame memory, 
the input video signal actually executes the conversion process by 
the parameter consisting the matrix. However, since both the data 
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road out from the frame memory and the image data displayed on the 
screen 11 are two-dimensional data, arithmetic operation for two- 
dimensional address does not need the parameters in the third line 
and third column of the equation (9) . 

Consequently, the conversion matrix T^a represented by the 
following equation which omits the third line and the third column 
from the equation (9) : 



Tl33 = 



rn - riaP.Ax ri2 mPt 
ri2—r23P*Ax r22 r23P« 

1, - 1* PzAx ly lzPz + So 



(10) 



is used as the matrix for converting the position vector Lx, y] on 
the frame memory to the position vector [X,, Y,] on the screen 11. 

Here, the conversion matrixes of four lines by four columns 
as shown in the equations (1) to (4) represent different 
dimensional conversions as the rotary conversion and 
enlargement/reduction in the same coordinate system, which makes 
the matrix of 4 X 4; this is generally called Homogeneous 
Coordinate . 

When the two-dimensional position vector [x, y] on the frame 
memory and the two-dimensional position vector [X., Y»] on the 
screen 11 are represented in the Homogeneous Coordinate, [x, y] 
can be represented to [x, y, H] and [X., Y B ] can be represented to 
[X,, Y,, 1] . H is the value showing an image enlargement ratio 
transformed by the perspective, which is proportioned to the value 
of the position vector in the direction of z-axis. 
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Operation of the conversion matrix Tu 3 to the position vector 
[x, y, H] on the frame memory can obtains the vector [X a , Y a , 1] . 
The obtained vector on the screen 11 is defined as follows: 

[X. Y. 1] = [x y H] ... (ll) 

In this embodiment, however, when the spatial image 
conversion is executed, an address on "the frame memory is 
specified to a screen address supplied sequentially corresponding 
to raster scanning as three-dimensional conversion at the time of 
reading cut the input data from the frame memory. 

More specifically, as shown in Fig. 5, when the inverse 
arithmetic operation as follows r 

[x y H] - [X. Y. 1] T^a" 1 . . . (12) 

is executed, the designation of the position vector [x, y, H] of 
the corresponding frame memory is made corresponding to sequential 
designation of the position vector [X», Y., 1] on the screen 11 
according to the raster scanning. Therefore, supply of the 
position vector [x, y, H] as the two-dimensional read-out address 
to the frame memory and the key memory provides the two- 
dimensional video data and key signal to which spatial image 
conversion is executed. 

The inverse conversion matrix T^s" 1 of the equation (12) can 
be obtained as follows. 

First, each element of the conversion matrix T U 3 is set as 
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parameters an to a 33 as follows : 



TL33 = 



rn - mPxAx riz 
r2i — r23P«Ax r22 
1» - lxP.Ax ly 



riaPz 

r2aP* 

IxPx + So 



(13) 





an 


ai2 


ais 






a2i 


a22 


a23 






aai 


a32 


a33 





Also, the parameters of the inverse matrix T^* 1 are 
represented as parameters b u to b 3 3 as follows: 





All 


ai2 


ai3 


-i 


"bu 


bi2 


bi3~ 


TL33 1 = 


a2i 


a22 


a23 




b2i 


b22 


b23 




aai 


a32 


a33 




b3i 


b32 


b33 



(14) 



Substitution the equation (14) into the equation (12) can 
represent the following equation: 



[x y H] = [X. Y. 1] 



bu 
bai 



bi2 

b22 
b32 



bl3 
b23 
b33 



(15) 



Above equation can be expanded to: 



[x y H] = [buX, + b 12 Y. + b 13 
b 2 iX, + b 22 Y. + b 23 
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b 3i X, + b 32 Y» + b 33 ] 



(16) 



The following equations are thus derived from the equation 



(16) : 



x = buX, + b 12 Y. + b 13 



(17) 



Y — b 2 iX s + b 22 Y s + b 23 



(18) 



H = b 3i X. + b 32 Y» + b 33 



(19) 



by which *-he value of each element of the position vector (x, y, 
H) on the frame memory c<*n be obtained. 

The position vector [x, y, H] on the frame memory, however, 
is on the Homogeneous Coordinate. Normalization of the coordinate 
values x, y by the parameter H can restore it to the two- 
dimensional coordinate system. 

Accordingly, the address [Xx^, Y^] on the frame memory can be 
obtained as follows : 



Xlm — — 

H 



(20) 



buXs + bx 2 Ys + bi3 



b3lX5 + b32Ys + b33 
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Yx. = * 
H 

(21) 

baiXs + b22Ya + bza 
baiXs + b32Ya + b33 



The data of the pixels corresponding to the screen address (X s , 
Y s ) thus can be read out sequentially from the frame memory and the 
key information memory by using the address data Xlm and Y w . 

In the equations (20) and (21) , the values of B X1 to b 33 are 
obtained as follows from the equation (14) : 



bn = 



bi2 = 



— asaa23 j- a2ga3 3 (22) 



a32ai3 — ai2a33 (23) 



Wi 



bl3 - = a2 ' ai3 - ai2a " < 24 > 

Wi 



= a 3 ia23 - a2ia33 (25) 
Wi 



— a3iai3 + ana 33 

b22 = • • ' ( 26) 

Wl 
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— a22aai + a2ia32 

bai = . - . (28) 

Wi 



ai2aai — ana32 

b32 = . . . (29) 

Wi 



. — ai2a;i + aiia^i 

*>« = . . . (30) 

Wi 



Provided that, .rt is: 

Wi ~ ~ 3^223-31^13 + a>2ia323l3 + 312^31323 

- ana32a 2 3 - ai 2 a 2 ia 33 + ana 22 a3 3 ... (31) 

Here, the values of an to a 3 3 are obtained as follows from the 
equation (13) : 

an = rn - ri 3 P z Ax, a i2 = r i2/ a i3 = r 13 P z ... (32) 

a 2 i = r 2 i - r 23 PzAx, a 22 = r 22 , a 23 = r 23 P z ... (33) 

a 3 i = lx - liP« A X; a 32 = l y , a 33 = l*Pr+S 0 ... (34) 

Thus, substitution of the above values into the equations 
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(22) to (31) can expresses the following equations: 



- l y r23P» + rz2(lzP» 4- So) (35) 
11 " Wi 



^ = l y ri 3 P, + mqA + So) (3g) 



- r22ri3P* + ri2r23P« tins 

J3l3 — • • * V - - ' / 

Wi 



b2i = 



(1* - l«P«Ax)r23P« - (r 2 i - raaP^Ax) (1*P« + So) 



- (lx - lxPzAx)ri3P* + (m - n sP.Ax) (1»P» + So) 

Wi 



(r2i - r23PxAx)risPx - (rxi - ri3P*Ax)r23 P* Mftl 



- r 2 2<lx - l«P*Ax) + (r2i - r23P«Ax)l y 

^31 — — . • . \ 4 ± ) 

Wi 



b32 = 



ri2(lx - lxPzAx) - (m - ri3PxZix)ly 
Wi 
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b33 = 



- ri2(r2i — r2aP»Ax) + (rn - ri3P»Ax)r22 

Wi 



(43) 



Wi = -r 22 (l x - lzP 2 A x) r 13 P t 
+ (r 21 -r 23 Pz A x) lyriaP* 
+ r 12 (l x - l : P z Ax)r 23 P 2 

- (r lt -ri3P z A x) l y r 23 P 2 

- r 12 (r 21 -r i3 Px A x) (1 Z P Z +S 0 ) 

+ (r u -r l3 P 2 A x) r 22 (1 Z P Z +S 0 ) . . . (44 ) 

by using the parameters set by the operator in the conversion 
matrixes represented in the equations (1) to (4) . 

Thus substitution of the values obtained in the equations 
(35) to (44) into the equations (20) and (21) supplies the read- 
out address (Xlm, Y^) as follows to the frame memory: 

Xs- = — [ {-l»r2 3 Pz + r2 2 (l«P« + So) } Xs 
H 

+ {l y r 13 P x + r 12 (l z P, + So)} Y s 

+ (-r 22 r 13 P z + r 12 r 23 P z ) ] ... (45) 

Yi» = — [ {1« - l.PxAx) r«P z 
H 

- (r 2 i-r 23 P z A x) <1 Z P Z + So) } X s 
+ <-<l z -l z P z A x r 13 P z 
+ (rn-r^P, A x) <1 Z P Z + S 0 ) } Y s 
+ {r 2 i-r 23 P, A x) r 13 P z 
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- (r X i-ri 3 Pz A x) r 23 P*} ] 



(46) 



Here, it is as follows: 

H = {-r 22 (l x -l t P 2 Ax) + (r 21 - r 23 P z Ax)l y } X s 
+ {r 12 (l*-l«P a A x) - (r u - r 13 P»Ax)l y } Y s 

+ {-r 12 (r 21 -r 23 P. A x) + (ru - r 13 P z A x)r 22 > . • • (47) 

The processes described above are the arithmetic operations 
for the left-eye image conversion to the object VI shown in Fig. 
4(A1). The arithmetic operations for the right-eye image 
conversion is also executed corresponding to the arithmetic 
operations for the left-eye image conversion as shown in Fig. 
4(A2) . 

More specifically, the three-dimensional conversion matrix T 0 
moves the object VI input as an image of the input video signal at 
the origin of x-y plane on the screen 11 in parallel in the depth 
direction on z-axis, and then rotates it to convert to an 
intermediate conversion image V2 . 

Then, as the conversion process for representing the visual 
difference of the right eye to the intermediate conversion image 
V2, parallel movement by -Ax movement matrix IT 1 represented by 
the equation (4) in the parallel direction of x-axis by the 
distance of -Ax converts the intermediate conversion image V2 to 
an intermediate conversion image V3. 

Then, conversion of the intermediate conversion image V3R by 
the see-through matrix P 0 represented by the equation (3) provides 
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an intermediate conversion image V4R in which the intermediate 
conversion image V3R has been seen through on the screen 11 . The 
intermediate conversion image V4R means that, when being at the 
position 12RX on the z-axis, the right eye 12R obtains the image 
V4R in which the intermediate conversion image V2 is seen through 
on the screen 11 in the direction of* the right eye 12R. 

The intermediate conversion image V4R is represented by the 
equation (2) . Being converted by the movement matrix L, the image 
V4R is moved in parallel in the direction of x-axis by the 

distance of +A x, and then is converted to an final intermediate 
conversion image VSR. 

This right-eye final intermediate image V5R is the image in 
which the intermediate conversion image V2 has Leen through on the 
screen 11 in the original direction of the right eye 12R when the 
right eye 12R at the original position shifted from the center on 
the z-axis (the center between the left eye 12L and the right eye 

12R) in right direction by A x sees the intermediate conversion 
image V2 . 

The operator can thus see the right-eye final conversion 
image V5R as the deep right-eye image 14R on the x-y plane 
executed the process based on the perspective, in which the front 
image portion is bigger and the image portion in depth direction 
becomes smaller. 

The conversion process for converting the object VI based on 
the input video signal to the right-eye final conversion image VSR, 
as shown in Fig. 4 (Bl) , is executed as follows similarly to the 
left-eye conversion process. 
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More specifically, the following conversion matrix T R on the 
arithmetic operation for the right eye is as follows: 



To Pr 



(48) 



which can be regarded that there are two parts; the three- 
dimensional conversion matrix T 0 which moves and rotary converts 
the object VI on z-axis, and the conversion matrix P R which 
executes the conversion process thereafter. The right-eye 
conversion matrix P R is represented by the -Ax parallel movement 
matrix L' 5 of the equation (4) , the see-through matrix P 0 of the 
equation (3) , and h A x movement matrix L of the equati on (2) as 
follows : 



Pr 



IT 1 P 0 L 



. (49) 



Substitution of the equations (4) , (3) and (2) into the 
equation (49) realizes the expansion as follows: 



Pr = 



1 
0 
0 

- Ax 
1 
0 

P.Ax 
0 



0 
1 
0 
0 
0 

1 

0 
0 



0 
0 

1 

0 

0 
0 
0 
0 



0 
0 
0 

1 

0 
0 

P, 

1 



0 

1 

0 
0 



0 
0 
0 
0 



0 
0 

p. 
1 



10 0 0 
0 10 0 
0 0 10 
Ax 0 0 1 



(50) 
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If the equation (50) is substituted into the equation (48) , 
the conversion matrix P R for executing the right-eye spatial image 
conversion can be expanded as follows: 



Pr = 



rn 


ri2 


ris 


0 


m 


T22 


r23 


0 


r3i 


X32 


r33 


0 


1* 


ly 


1. 


So 



1 0 0 0" 

0 10 0 

PxAx 0 0 Px 

0 0 0 1 



fru + ruPzAx ria 

T2l + r23PsAx r22 

rsi + rssPsAx rs2 

lx + lxPxAx ly 



0 
Q 
0 
0 



(51) 



ri3P* 

r23Px 

r^P. 

lxPx + So 



In order to obtain significant information of only the x-y 
plane, the right-eye conversion matrix Tr3 3 which is represented by 
omission of the third line and third column of the equation (51) 
as the following equation: 



TR33 = 



m + nsPxAx ri2 risPx 
ri2 + r23PxAx r22 r23Px 

lx + lxPxAx ly lxPx + So 



(52) 



is used. 

Also the right-eye conversion process can obtain the vector 
[X s Y s 1] on the screen 11 by operating the conversion matrix Tr3 3 
to the position vector [x y H] on the frame memory as mentioned 
above with regard to Fig. 5. The vector on the screen 11 thus 
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defined by the following equation: 



[X s Y s 1] - [x y H] T103 



(53) 



Then, in order to obtain the read-out address used for 
reading out video data from the frame memory, the above equation 
is inversely calculated as follows: 



[x y H] - [X s Y s 1JT: 



L33 



(54) 



This enables to specify the position vector [x y H] of the 
frame memory corresponding to the position vector [X s Y s 1] on the 
scre&a II when the position sector [X s Y s 1] is specj.tied according 
to raster scanning. It is thus possible to obtain the two- 
dimensional video data and key signal spatially converted the 
image . 

Here, in order to obtain the inverse conversion matrix T^" 1 , 
the par_uri«t^r s an to a33 and bn to b33 are set as elements for the 
conversion matrix Tr3 3 and the inverse conversion matrix T^" 1 as 
follows : 



TR33 = 



m + ri3PzAx ri2 
r2i + r23PxAx r22 

1, + lzPzAx ly 





an 


ai2 


ai3 




a2i 


a22 


a23 




aai 


a32 


a33 



ri3P* 

T23Px 
IzPz + So 



(55) 
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an 


ai2 


ai3 




bn 


b« 


bis 






aai 


3L22 


a23 






b22 


b23 


. . . (56) 




aai 


a32 


a33 






b32 


b33 





Those equations permits to obtain the parameters bi X to b 33 as 
follows : 



bn = 



— a^2a23 + a2?a33 
Wi 



(57; 



bu - 



as2ai3 — ai2a33 
Wi 



>?) 



bis = 



a22ai3 + ai2a23 



(59) 



b 2 i = 



aaia23 — a2ia33 
Wi 



(60) 



b22 = 



a3iai3 + ana 33 
Wi 



(61) 



b23 = 



a2iaia — ana23 



(62) 
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— a22a3i + a2iaa2 

b31 = — * * • t bd > 

Wi 



b 32 = 312331 = aiia32 < 64 > 

Wi 



— ai2a2i + ana22 /^cv 

baa = • • - (6^) 

Wi 



hcr* f it is as follows: 

Wi — - a2?a3iai3 + ^21^32^13 + 3t2&3i92^ 

- ana32a23 ~ ^12^21^33 + ^11^22^33 - • • (66) 

The parameters an to a 33 are obtained from the equation (55) 
as follows: 

an = rn + r^P, Ax, a i2 = r 12/ ai 3 = ri 3 P* - • <£~> 

a 2 i = r 2 i + r 2 3P z Ax, a 2 2 = r 2 2, a 2 3 = r 23 Pz - • . (68) 

a 31 = l x + l 2 P z Ax, a 32 = l y , a 33 = lzP*+S 0 ... (69) 

By substituting those equations into the equations (57) to 
(66) as follows: 
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- ljrr23Pz + r22(lxP* + So) 

Wi 



l y ri3P« + ri2(lzPz + So) 
Wi 



- r22riaPi + ri2r2aPx 
Wi 



(I« + l »PgAx)r23Pz - (r21 + T23P xAx) (IzPz + So) 



- (1« + !»PzAx)ri3Pz + (m + risPzAx) (l»Pz + So) 

Wi 



(rai + r23PzAx)ri3Pz - (m + ri3PzAx)r23Pz 

Wi 



- r 2 2(l» + l»PrAx) + (r 2 i + r 2 3PzAx)l Y 
Wi 



ri2(l« + lzPzAx) - (m + ruPzAx)l y 
Wi 



- ri2<r2i + r23PzAx) + (m + ri3PzAx)r22 

Wi 
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W x = -r 22 (l x + l 2 P a Ax)r 13 P z 
+ (r 21 +r 23 P 2 A x) l y r 13 P r 
+ r i2 (l x + lzPz A x) r 23 P* 

- (r n +r 13 P 2 A x) l y r 23 Pz 

- r 12 (r 21 +r 23 P z A x) (lzPz+So) 

+ (r u +r 13 Pz A x)r 22 (lzPz+S 0 ) < 79 > 

the values of each element in the matrix can be represented by the 
parameter in which the operator sets as the conversion condition 
as the equations (1) to (4) . 

Incidentally, same manner as the above-mentioned equations 
(15) to (21) can applied to the right-eye conversion arithmetic 
operation. Substitution of relation of the equation (54) into the 
equation (56) can represent the following equation: 





bu 




bi3 




[x y H] = [X. Y. 1] 






b 23 


. . . (80) 






b32 


b33 





which shows the position vector [x y H] by the position vector [X s 
Y s 1] and the parameters bu to bi 3 . Then, expansion of this 
equation as follows: 

[x y H] - [buX, + bi 2 Y, + b i3 
b 2 iX» + b 22 Y a + b 23 

b 3I X, + b 32 Y, + b 33 ] . • . (81) 
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can deduce the position vector [x y H] on the frame memory as 
follows : 

x = buX, + b x2 Y. + b 13 ... (82) 

y = b 2 iX, + b 22 Y» + b 23 ... (83) 

H = b 31 X» + b 32 Y. + b 33 ... (84) 

Since the position vector [x y H] on the frame memory is tho 
homogeneous coordinate, normalization by the parameter H can 
deduce the address (X^ Y^) on the frame memory as follows: 



X^ = * 
H 



... (85) 

buXa + bi*Ys + bia 



b3lXs + b32Ys + b33 



Y*m = — 



. . . (86) 

baiX* + b22Ys + b23 

b3lXs + b32Ys + b33 



Then, by substituting the equations (70) to (79) into the 
equations (85) and (86) , the read-out address (Xpm Y^) to the frame 
memory can be set as follows : 
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X*« = — [ {-lxT23Px + r22(lxPx + So) } Xs 

H 

+ {l y r 13 P s + r 12 (l z P z + So)} Y s 

+ (-r 22 r i3 P 2 + r 12 r 23 P 2 ) ] (87) 

Y»- = —[{1*4- l.PxAx) r 23 Px 
H 

- (r 2i + r 23 P z A x) (1 2 P 2 + So) } X s 
+ {-(l x + 1 2 P„ A x r 13 P 2 

+ (r L1 + r 13 Pz A x) <1 2 P 2 + So) } Y s 
+ {r 2i + r 23 P z A x) r 13 P 2 

- (1*1 < r 13 P r A x) r 23 P z }] ... (88) 
Here, it is as follows: 

H « {-r 22 (l x +l 2 P 2 A x) + (r 12 + r 23 P 2 A x) • l y ) X s 
+ (r 12 (1,+lzPz A x) - (r xl + r 13 P 2 Ax) - l y ) Y s 
+ {-r i2 ' (r^r 23 P 2 Ax) + <ru ■+ r ir P 2 A x) r 22 ) . (89) 

According to the stereoscopic image generation method 
described above, the intermediate conversion images V3L and V3R 
both of which the object VI shown by the input video signal is 
moved and rotated in the depth direction and also moved in A x and 
-Ax directions are seen through on the screen 11 in the direction 
along the operators' left eye 12L and right eye 12R. Thereby the 
final conversion images V5L and VSR to be projected can be 
obtained by visual difference between the left eye 12L and the 
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right eye 12R. This enables to generate the deep image of the 
object on the screen , or backward the screen , or front in the 
screen based on the visual difference between the left eye 12L and 
the right eye 12R. 

Then, the operator inputs each parameter of the three- 
dimensional conversion matrix T 0 defined by the equation (1) , + A x 
movement matrix L defined by the equation (2) , the see- through 

matrix P 0 defined by the equation (3)/ and - Ax movement matrix L" 1 
defined by the equation (4) , so that it is possible to generate 
stereoscopic im?.ge having arbitrary conversion correspondence at 
arbitrary position as necessary. 

According to the processes described above, it is possible to 
arbitrarily select the parameters in whieh the operator can s<=L 
such as rn to r 33 representing spatial rotation of the converted 
image, l x , i y and l z representing parallel movements in the 
directions of x, y and z-axes, S 0 representing two-dimensional 
expan si on /reduction, P z representing the perspective value based on 
the perspective, and the value Ax representing a half of distance 
between the left eye 12L and the right eye 12R if the occasion 
demand. The image to be generated thus can be specified easily. 

Further, the image data representing the image of the input 
video signal is written in and its read-out address is specified 
corresponding to the raster scan address on the screen. This 
enables to generate the left-eye and right-eye final conversion 
images V5L and V5R on the screen 11 at the same time. 

(2) First Embodiment of the Stereoscopic Image Generation 
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Apparatus 

In Fig. 6, 21 entirely shows a stereoscopic image generation 
apparatus, which receives an input video signal V A/ an input key 
signal K*, and an input background signal V BK at a left-eye 
processor 22L and a right-eye processor 22R, and supplies a left- 
eye and right-eye stereoscopic image output signals VLout and VRout 
respectively representing the left-eye and right-eye final 
conversion images V5L and VSR to a left-eye and right-eye 
projectors 23L and 23R. 

This permits the left-eye and r.ight-eye projector 23L and 23R 
to project the left-eye and right-eye final conversion image V5L 
and VSR on a screen 24 respectively. 

left-eye processor 22L ^nd the rigl^-e^a processor 22R, 
and the left-eye and right-eye projectors 23L and 23R are 
controlled by a central process unit (CPU) 32 via a bus 31. 

According to a program in a program memory 33 having ROM 
structure, the CPU 32 utilizes a working memory 34 having RAM 
structure to execute process operation of each part in the 
stereoscopic image generation apparatus 21. 

The CPU 32 generates write-in address signals Sx and Sy 
representing position vector [x y] on the frame memory at a write- 
in address generation circuit 35. The write-in address signals Sx 
and Sy sequentially specify storing position in frame memories 36L 
and 36R of the left-eye and right-eye processors 22L and 22R so as 
to store the input video signal V A as left-eye and right-eye source 
video data synchronizing with each other. 

The write-in address signals Sx and Sy are also supplied to 
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key signal memories 37L and 37R of the left-eye and right-eye 
processors 22L and 22R. This enables the key signal memories 37L 
and 37R to store the key data in regard to the position vector [x 
y] on the frame memories synchronizing with the input video signal 

The CPU 32 drives a screen address generation circuit 38 
provided for common use of the left-eye and right-eye processors 
22L and 22R so as to generate the position vector [X s Y s ] on the 
screen 24 based on a reference signal generated from a built-in 
reference signal generation circuit. These screen addresses SX S 
and SY S are supplied to read-out addross generation circuits 39L 
and 39R of the left- eye and right-eye processors 22L and 22R. 

The read- out. address generation circuits 3$±a and 39F are 
under the control of the CPU 32 so as to supply read-out address 
signal SX^, SYj^ and SX^, SY^ representing read-out addresses (X^ 
YnJ and (Xpa Ypa,) , which are respectively specified by the 
equations (45) , (46) and (87) and (88) , to the frame memories 36L 
and ?3R s»-id the key data memories 37L and 37R. 

Image data VI^ and VR X read out from the frame memories 36L 
and 36R of the left-eye and right-eye processors 22L and 22R are 
interpolated at video signal interpolation circuits 40L and 40R, 
and then are supplied to combiners 41L and 41R as read-out video 
signals VL 2 and VR 2 * 

At the same time, key data KLi and KR X read out from the key 
signal memories 37 and 37R of the left-eye and right-eye 
processors 22L and 22R are interpolated at the key signal 
interpolation circuits 40L and 40R, and then are supplied to the 
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combiners 42L and 42R as read-out video signal KL 2 and KR 2 . 

The combiners 41L and 41R are under the control of the CPU 32 
so as to execute the keying process between the read-out video 
signals VL 2 and VR 2 and the input background signal V BK by the read- 
out key signals KL 2 and KR 2 . The combiners 41L and 41R 
consequently supply the stereoscopic image output signals VTjo Ut and 
VRout represented by the following equations: 

VLou t = KL 2 VL 2 + <1-KL 2 )V BK <90) 

VRout = KR 2 VR 2 + (1-KR 2 )V BK - - • OD 

as the output from the left-eye and right-eye processors 22L and 
22R to the left-eye and right-eye projectors 23L and 23R. 

The following description will be made of operation of the 
stereoscopic image generation apparatus 21. 

First, the operator previously inputs the values of visual 
difference distance A x and perspective value P 2 necessary to the 
arithmetic operation of the present invention via a control panel 
51. The CPU 32 stores the visual difference distance Ax and the 
perspective value P z newly set by the operator in the RAM 34 . 
Incidentally, when detecting no input from the operator, the CPU 
32 uses the reference value (Ax = 3.25cm, P 2 = -1/16) stored 
already in the RAM 34 . 

Then the operator operates a three-dimensional pointing 
device provided on the control panel 51 to command three- 
dimensional image conversion operation to source video signal . 
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When the operator commands the three-dimensional conversion 
process to the source video signal, the CPU 32 receives r u to r 33/ 
1,, l y/ l x and S 0 which are parameters of matrix T 0 showing the 
three-dimensional conversion specified by the operator. At the 

same time, the CPU 32 receives the visual difference distance A x 
and the perspective value P z stored in the RAM 34. Then, the CPU 
32 utilizes the received parameters ru to r 33 , l x , l y , l z and S 0 , 

A x and P z so as to calculate the parameters bn to b 33 represented 
in the equations (35) to (43) and the parameters bn to b 33 
represented in the equations (70) to (78) . The CPU 32 supplies the 
calculated values of the parameter bn to b 33 to the read-out 
address generation circuit 39L; simultaneously supplies the 
caicuiated values of tne parameter b lx Lo b 33 to the read-out 
address generation circuit 39R. 

The read-out address generation circuit 39L generates the 
left-eye read-out address (Xun, YuJ represented in the equation 
(20) based on the parameters ru to r 33 supplied from the CPU 32 and 
the screen address (X s , Y s ) supplied from the screen address 
generation circuit 38. The read-out address generation circuit 39L 
supplies the left-eye read-out address (X^, YnJ to the frame 
memory 36L and the key signal memory 37L. 

At the same time, the read-out address generation circuit 39R 
generates the right-eye read-out address (Xrb, Y^) represented in 
the equation (85) based on the parameters bn to b 33 supplied from 
the CPU 32 and the screen address (Xi«, YuJ supplied from the 
screen address generation circuit 38. The read-out address 
generation circuit 39R supplies the right-eye read-out address (X^,, 



36 



YRm) to the frame memory 36R and the key signal memory 37R, 

As described above, the conversion video signal VL X read out 
from the frame memory 36L represents the video signal V5L which is 
projected on the screen surface when the operator sees the video 
signal V2 converted in the three-dimensional space by the spatial 
conversion matrix T 0 from the position of the left eye 12L, as 
shown in Fig. 4 (Al) : the conversion video signal VR X read out from 
the frame memory 36R represents the video signal V5R which is 
projected on the screen surface when the operator sees the video 
signal V2 converted in the three-dimensional space by the spatial 
conversion matrix T 0 from the position of the right eye 12R, as 
shown in Fig. 4 (A2) . 

The conversion video signals VJbi and V~Ri i«ad cut from the 
frame memories 36L and 36R are interpolated at the video signal 
interpolation circuits 40L and 40R with peripheral pixels, and 
then are output as the conversion video signals VL 2 and VR 2 . The 
conversion key signal KLi and KR X read out from the key signal 
memories 37L and 37R are similarly interpolated at the key signal 
interpolation circuits 42L and 42R with peripheral pixels, and 
then are output as the conversion key signal KL 2 and KR 2 . 

As described above, capture of the input information input by 
the operator with the control panel 51 through an interface 52 
enables the CPU 32 to provide the left-eye and right-eye 
projectors 23L and 23R with the left-eye and right-eye 
stereoscopic image output signal VLout and VRout/ which are 
generated by converting the input video signal V A and the input key 
signal at the same time according to the contents of image 
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conversion process specified by the operator, from the left-eye 
and right-eye processors 22L and 22R. 

Here, if the operator sets the parameters rn to r 33 with the 
control panel 51, the CPU 32 specifies what degree the object VI 
should rotate spatially in regard to the three-dimensional 
conversion matrix P 0 at the read-out address generation circuits 
39L and 39R. 

Further, if the operator sets the parameters l x , l y and 1 2 
with the control panel 51, the CPU 32 specifies how far the object 
VI should move in parallel in the direction of x-axis , y-axis and 
z-axis in regard to the three-dimensional conversion matrix P 0 at 
the read-out address generation circuits 39L and 39R. 

Further, if the operator s^ts LLe parameter 2 C witn the 
control panel 51, the CPU 32 specifies how large or small the 
object VI should be extended or reduced on the xy plane in regard 
to the three-dimensional conversion matrix P 0 at the read-out 
address generation circuits 39L and 39R. 

Further, if the operator sets the parameter A x with the 
control panel 51, the CPU 32 generates the read-out address 
signals SX to , SYu* and SXr*, SYr* which regulate how far the distance 
A x, the half of the distance between the left eye 12L and the 
right eye 12R, should be in regard to the + Ax movement matrix L 
and -Ax movement matrix L" 1 , namely how far visual difference 
between the left eye 12L and the right eye 12R should be. 

In this embodiment, the parameter P 2 is structured so that the 
value is input as 1/16 all the time from the control panel 51. The 
CPU 32 thus outputs the read-out address signal for regulating the 
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perspective value based on perspective for the see-through matrix 
P 0 at the read-out address generation circuits 39L and 39R. 

The operator therefore can set the parameter A x for 
regulating the visual difference between the left eye 12L and the 
right eye 12R on desired value by the control panel 51 . This 
enables to set easily the amount of shift of the left-eye image 
14L and the right-eye image 14R consisting of the final converted 
images V5L and VSR, which are projected on the screen 24 by the 
left-eye and right-eye projectors 23L and 23R, on the appropriate 
value at will . 

As described above, the read-out address generation circuits 
39L and 39R of the left-eye and right-eye processors 22L and 22R 
execute their processes at the same tiiti^ based on common screen 
address signals SX, and SY m , so that the left-eye and right-eye 
stereoscopic image output signals VLou t and VRout are generated 
simultaneously. This provides the stereoscopic image having better 
picture quality. 

According to the structure described above, the le^t-eye 
perspective conversion matrix P L and the right-eye perspective 
conversion matrix are utilized in the arithmetic operation of the 
left-eye video signal and the right-eye video signal in which the 
conversion video signal converted to the spatial position by 
moving and rotating the source video signal VI in the three- 
dimensional space is projected on the xy-plane from the position 
of the left eye 12L and the position of the right eye 12R 
respectively. The appropriate video signal according to the visual 
difference between the left eye and the right eye therefore can be 
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generated . 

Further, it is possible to generate the left-eye video signal 
and the right-eye video signal both of which have the visual 
difference according to the spatial position of the converted 
video signal V2 . In other words , such arithmetic operation is 
executed as the more the source video signal is converted to the 
position of the depth direction (direction of +z) three- 
dimensionally to the screen, the more the left-oye video signal 
shifts to left and the right-eye video signal shifts to right. 
Further , such arithmetic operation is also executed as the source 
video signal is converted to the position of the front direction 
(direction of -z) three -dimensionally to the screen in contrast 
with the above, th* more the. left -eye video signal shifts to right 
and the right-eye video signal shifts to left. This enables to 
generate stereoscopic video signal easily. 

(3) The Second Embodiment of the Stereoscopic Image Generation 
Apparatus 

Fig. 7 shows the second embodiment of the present invention 
in which the same number is applied to the corresponding part of 
the stereoscopic image generation apparatus 61 in Fig. 6. The 
left-eye and right-eye stereoscopic image output signals VLqut and 
VRour obtained from left-eye and right-eye projectors 62L and 62R 
are output to the left-eye and right-eye projectors 23L and 23R 
respectively and recorded in left-eye and right-eye video signal 
recording devices 63L and 63R consisting of, for example, video 
tape recorders . 
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The left-eye and right-eye video signal recording devices 63L 
and 67R are controlled by the CPU 32 so as to reproduce the 
recorded video signal as left-eye and right-eye feedback video 
signals VBL and VBR and feedback them to the frame memories 36L 
and 36R of the left-eye and right-eye processors 62L and 62R as 
image input signals VL 0 and VRo through switching input terminal W2 
of switches 64L and 64R. 

In this embodiment, the input video signal V A is input to the 
frame memories 36L and 36R as input video signals WL 0 and WRo 
through two first switch terminals Wl of the left-eye and right- 
eye switches 64 L and 64R both of which execute switching 
operations controlled by the CPU 32. 

The input video signal?? V±+, and VP* inpu^: tlu oagh the lei L eyo 
and right-eye switches 64L and 64R are also input to key signal 
generation circuits 65L and 65R of the left-eye and right-eye 
processors 62L and 62R. Thus the CPU 32 controls to input input 
key signals KL 0 and KRo capable of keying process synchronized with 
the input video signals VLo and VRo from the key signal generation 
circuits 65L and 65R both of which execute the key signal 
generation operations to the key signal memories 37L and 37R. 

With the structure of Fig. 7, as shown in Figs. 8(A) and 8(B), 
the first left-eye and right-eye images 70L and 70R out of images 
projected on the screen 24 from the left-eye and right-eye 
projectors 23L and 23R are projected on part of the screen 24, for 
instance the left part, and the second left-eye and right-eye 
images 72L and 72R are projected on the other part of the screen 
24, for instance the right part. 
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The first left-eye and right-eye images 70L and 7 OR convert 
the image represented by the input video signal V A with the image 
conversion method described above referring to Figs. 4 (Al) to (B2) . 

In this embodiment, the operator recognizes the first left- 
eye and right-eye images 70L and 70R as a stereoscopic image 71 
formed based on the input video signal V x by seeing virtual image 
with the operator's left and right eyes 12L and 12R. 

On the other hand, the second left- eye and right-eye images 
72L and 72R projected on the right part of the screen 24 are such 
images as the images represented by the left-eye and right-eye 
feedback video signals VBL and VBR reproduced from the leCt-eye 
and right-eye video signal recording devices 63L and 63R are read 
out f x oia the v;*deo memories 3GL and 36K wita tnc read-out address 
signals SXnn, SYlo and SXpm, SYr*, which are executed the image 
conversion process with the image conversion method described 
above according to Figs. 4 (Al) to 4 (B2) , and then projected on the 
screen 24 . 

In the case of Fig. 8 (A) , the operator's left eye 12L and 
right eye 12R toward the second left-eye and right-eye images 72L 
and 72R intersects with each other in front of the screen 24 . This 
enables the operator to recognize a stereoscopic image 73 formed 
by the left-eye and right-eye feedback video signals VBL and VBR 
in the virtual space in front of the screen 24 . 

With the structure shown in Fig. 7, the left-eye and right- 
eye switches 64L and 64R are controlled by the CPU 32 so as to let 
the video signal V A through the first switch input terminals Wl at 
the timing of left portion out of the image section for one frame. 
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The video signal V A is then stored in the left memory area of the 
left-eye and right-eye frame memories 36L and 36R. 

On the other hand, the left-eye and right-eye switches 64L 
and 64R switch to the second switch input terminals W2 in the term 
of left portion out of the term for one frame, so that the left- 
eye and right-eye feedback video signals VBL and VBR are stored in 
the frame memories 36L and 36R. 

As a result, the image data for one frame including two video 
data is stored in the frame memories 36L and 36R, and the read-out 
address signal is generated by being executed the image conversion 
process at the read-out address generation circuits 39L and 39R 
under the control of the CPU 32. Thus the left-eye and right-eye 
stereoscopic iarage output signals Vi^t- and VRout consxsung of U.a 
image for one frame representing the first left-eye and right-eye 
video signals 70L and 70R and the second left-eye and right-eye 
images 72L and 72R are output to the projectors 23L and 23R. 

The left-eye and right-eye stereoscopic image output signals 
VLout and VR^t representing the image for one frame to which the 
image conversion process is executed are stored in the left-eye 
and right-eye storing devices 63L and 63R, and then onl* the video 
signals of the second left-eye and right-eye images 72L and 72R 
are stored as the left-eye and right-eye switches 24L and 24R in 
the frame memories 36L and 36R through the left-eye and right-eye 
switches 24L and 24R. 

Here, if the input video signal V A is exactly the same as it 
has been, only the second left-eye and right-eye images 72L and 
72R out of the image data for one frame stored in the frame 
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memories 36L and 36R are changed with the image conversion process 
at the read-out address generation circuits 39L and 39R. 

In this state, if the read-out address generation circuits 
39L and 39R are controlled by the CPU 32 so as to execute again 
the image conversion process, only the second left-eye and right- 
eye images 72L and 72R are executed the image conversion process 
shown in Figs. 4 (Al) to 4 (B2) , and then output to the projectors 
23L and 23R as the left-eye and right-eye stereoscopic image 
output signals Vl^t and VR^. 

The image conversion process is executed time and again on 
the second left-eye and right-eye images 72L s,r*d 72P projected on 
the right part of the screen 24 by the projectors 23L and 23R, so 
that, the stereoscopic image 73 for^d toy Ui^ foedija^V v.L-i*?o 
signals VBL and VBR is changing sequentially in every frame. On 
the contrary, the stereoscopic image 71 formed by the first left- 
eye and right-eye images 70L and 70R which are based on the input 
video signal V A with no change in its contents does not change. 
Therefore the operator recognizes it as the fixed image. 

As described above, according to the structure shown in Fig. 
7, only the desired part of the stereoscopic image generated on 
the screen 24 can be fed back as the left-eye and right-eye 
feedback video signals VBL and VBR to the frame memories 36L and 
36R. It is thus possible to easily generate the stereoscopic image 
as if a part of the stereoscopic image is changing by the image 
conversion process repeatedly executed. 

(4) The Other Embodiments 
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In the embodiments described above, previous fixation of the 
parameter P, in the equation (3) for the see-through matrix P 0 to 
1/16 keeps the perspective value based on the perspective. However, 
the present invention is not only limited to this, but if the 
parameter P* is changeable according to the operation with the 
control panel 51 by the operator, the same effect as the above- 
mentioned embodiment can be obtained. 

Further, in the above-mentioned embodiment of Fig. 7 , 
feedback of a part of image projected on the screen 24 to the 
frame memories 36L and 36R enables to repeatedly execute the image 
conversion process on the part of image. However, the present 
invention is not only limited to this, but the image conversion 
pre ess c^n be repeatedly executed on entire iifiage genorateU on 
the screen 24 . 

Further, in the embodiment described above, projection of the 
left-eye and right-eye stereoscopic image output signals VLo Ut and 
VRout on the screen 24 by the left-eye and right-eye projectors 23L 
and 23R generates the stereoscopic image. However, display means 
of stereoscopic image is not only limited to this, but the other 
type of image displaying apparatus, for example a head-mounted 
type image apparatus, can be utilized. 

Further, in the above-mentioned embodiment of Fig. 7, video 
tape recorders are utilized in the left-eye and right-eye video 
signal recording devices. However, the video signal recording 
apparatus is not only limited to this, but the other image 
recording devices can be utilized such as a video disc device or a 
semiconductor memory devices . 
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Industrial Applicability 

The present invention can be applied to a stereoscopic image 
generation apparatus which generates stereoscopic image by using 
video signal representing two-dimensional image. 
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CLAIMS 

1. A stereoscopic image generation apparatus for generating 
video signal in order to obtain stereoscopic effects visually, 
comprising: 

a left-eye processor for generating left-eye stereoscopic 
video signal from source video signal based on a spatial image 
conversion matrix for image conversion which converts an image 
represented by said source video signal to virtual spatial 
position, and a left-eye perspective conversion matrix for having 
a converted image represented by the converted conversion video 
signal seen through on a screen; and 

a right-eye processor for generating right-eye stereoscopic 
video frxgnaJ from taid source video signal based on s&.'-d spatial 
image conversion matrix and a right-eye perspective conversion 
matrix for having a converted image represented by said conversion 
video signal seen through on the screen. 

2 . The stereoscopic image generation apparatus according to 
claim 1, wherein 

said left-eye stereoscopic video signal is a two-dimensional 
video signal which is seen through on said screen when an image of 
said conversion video signal at the virtual spatial position is 
looked from the spatial position of said left eye as the point of 
view; and said right-eye stereoscopic video signal is a two- 
dimensional video signal which is seen through on said screen when 
a image of said conversion video signal at the virtual spatial 
position is looked from the spatial position of said right eye as 
the point of view. 
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3. The stereoscopic image generation apparatus according to 
claim 1, comprising: 

screen address generation means for generating sequential 
screen address corresponding to raster scanning; wherein 

said left-eye processor and said right-eye processor operate 
simultaneously in response to said screen address so that said 
left-eye stereoscopic video signal from said left-eye processor 
and said right-eye stereoscopic video -signal from said right-eye 
processor are output at the same timing with each other. 

4. The stereoscopic image generation apparatus according to 
claim 1 , wherein : 

each parameter in said spatial image conversion matrix is the 
value set in ea^L frame leased or. the irr^ge conversion operatica 
which the operator desires; and 

each parameter in said left-eye perspective conversion matrix 
and said right-eye perspective conversion matrix is the value 
previously set by the operator, 

5. The stereoscopic image generation apparatus according to 
claim 1 , wherein : 

said spatial image conversion matrix T 0 is defined as follows; 



To = 



rn ri2 ria 0 

r:i r22 rza 0 

T2X r32 r33 0 

lx ly 1, SO 



said left-eye perspective conversion matrix P L is defined as 
follows ; 
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10 0 0 
0 10 0 
^ = -P,Ax OOP. 

0 0 0 1 

said right-eye perspective conversion matrix P R is defined as 
follows ; 

r i ooo" 

0 10 0 

Pr = 

PxAx OOP. 

0 0 0 1 

provided that, rn to r 33 are the parameters representing 
spatial rotary conversion; 

l x is the pararuatfci representing parallel mover*-rint in the 
direction of x-axis; 

l y is the parameter representing parallel movement in the 
direction of y-axis; 

1 2 is the parameter representing parallel movement in the 
direction of z-axis; 

So is the parameter representing two-dimensional extension and 
reduction; 

P z is the perspective value previously set; and 
A x is the value representing a half of distance between the 
right-eye and left-eye, 

6. The stereoscopic image generation apparatus according to 
claim 5, wherein: 

said left-eye perspective conversion matrix P L is obtained as 
follows ; 
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P L = LPo L" 1 



said right-eye perspective conversion matrix P„ is obtained as 
follows ; 

P R = L" 1 LPo 

provided that, the matrix L is defined as follows; 

0 0" 

0 0 

1 0 
0 1 

the matrix IT 1 is defined as follows; 

0 0" 

0 0 

1 0 
0 1 

and the matrix P 0 is defined as follows; 

0 0 " 

0 0 

1 P. 
0 1 

7. The stereoscopic image generation apparatus according to 
claim 6, wherein: 

said left-eye processor comprises 

first storing means for storing said source video signal 
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L = 



I 0 
0 I 
0 0 
Ax 0 



If 1 = 



1 0 

0 1 

0 0 

-Ax 0 




temporarily; and 

first read-out address generation means for generating read- 
out address, which is calculated based on said spatial image 
conversion matrix and said left-eye perspective conversion matrix, 
for reading out the video signal stored in said first storing 
means ; 

said right-eye processor comprises 

second storing means for storing "said source video signal 

temporarily; and 

second read-out address generation means for generating read- 
out address, which is calculated based on said spatial conversion 
matrix and said right-eye perspective conversion matrix, for 
reading out the video signal stored in said second storing means. 
8. The stereoscopic image generation apparatus according to 
claim 7, wherein: 

read-out address (X^, Y^) supplied to said first storing 
means are as follows; 

X*l = — [ {-1* • r 23 • P. + r*2(lxP. + So) } • Xs 
Hi 

+ {l y * r 13 • P z + r 12 (l z P z + So) } Y s 
+ <-r 22 • r 13 • P, + r 12 ■ r 23 • P«) ] 

Y«l = — [ {lx - l.PxAx) r23P« 

Hl 

- (r 21 -r 23 P z A x) • (lxPz + So) } X s 

+ {-<l*-l*Pz Ax • r« • P. 

+ (ru-ruP, A x) • (IzP, + So) } Y s 

+ {r 21 -r 23 P, A x) • r i3 ■ P z 
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- (r ir r 13 P, Ax) ■ r 23 • P x } ] 

provided that, the definition will be made by the following 
equation; 

H L = {-r 22 (l*- 1 2 P 2 A x) + (r 21 - r 23 P z A x) • l y } X s 
+ <r 12 (l x - l.P z Ax) - ( ril - r 13 P z Ax) • l y } Y s 
+ {-r 12 - (r 21 - r 23 P 2 A x) + (r^ - r 13 PzAx)r 22 } 

read-out address (X^r, Y»r) supplied to said second storing 
means are; 

X-R = — [ {-lx • r2Z • P* + T22 (lzPz + So) } • XS 

+ (lyTia'P, + r 12 (l«P,+ So)} Y s 
+ (-r 22 • r 13 • P« + r 12 • r 23 • P«) ] 

Y«* = — [ {lx + lxP.Ax) rasPx 
Hr 

- (r 21 + r 23 P, A x) • (l.P, + S 0 ) > X s 
+ { - (1, + 1,P, A x • r 13 • P z 

+ (ru + r 13 P, A x) • (1 X P X + So) ) Y s 

+ { r 21 + r 23 P. A x) • r 13 P z 

- (r lx + r 13 P. Ax) • r 23 • P,} ] 

provided that, the definition will be made as follows; 
H R = { -r 22 (lx+lzPz A x) + (r 2i + r 23 P x A x) • l y } X s 
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+ {r 12 (l x +l x P z A x) - (r xl + r 13 P x Ax) • l y ) Y s 
+ {-r i2 ' (r 21 +r 23 P z Ax) + dn + r 13 P 2 Ax)r 22 } 



and, X s and Y s are screen addresses corresponding to the 
raster scanning. 

9. The stereoscopic image generation apparatus according to 
claim 8, wherein 

said same screen addresses are sequentially supplied to both 
of said first read-out address generation means and said second 
read-out address generation means. 

10. The stereoscopic image generation apparatus according to 
claim 7, comprising: 

write-in address generation means for generating write-in 
address for writing said source video signal in said first storing 
means and said second storing means, and wherein: 

the same write-in addresses are supplied from said write-in 
address generation means to said first storing means and said 
second storing means, respectively. 

11. The stereoscopic image generation apparatus according to 
claim 1, wherein: 

key signal corresponding to said source video signal and 
background video signal used for the background of said source 
video signal are supplied to said left-eye processor and said 
right-eye processor, respectively; 

said left-eye processor comprises 

first image conversion means for executing the first spatial 
image conversion to said source video signal and for executing the 
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same spatial image conversion as said first spatial image 
conversion to said key signal based on said spatial image 
conversion matrix and said left-eye perspective conversion matrix; 
and 

first video signal composition means for composing the video 
signal converted by said first image conversion means with said 
background video signal based on the key signal converted by said 
first image conversion means; and 

said right-eye processor comprises 

second image conversion means for executing the second 
spatial image conversion to said source video signal and for 
executing the same spatial image conversion as said second spatial 
image conversion to said key signal based on said spatiax image 
conversion matrix and said right-eye perspective conversion 
matrix; and 

second video signal composition means for composing the video 
signal converted by said second image conversion means with said 
background video signal based on the key signal converted by said 
second image conversion means . 

12. The stereoscopic image generation apparatus according to 
claim 1, further comprising: 

a first recording/reproducing device for recording the output 
video signal output from said left-eye processor to a recording 
medium and for reproducing the recorded video signal from the 
recording medium; 

a second recording/reproducing device for recording the 
output video signal output from said right-eye processor to a 
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recording medium and for reproducing the recorded video signal 
from the recording medium; 

first key signal generation means for generating key signal 
from the first reproduced video signal reproduced from said first 
recording/ reproducing device; 

second key signal generation means for generating key signal 
from the second reproduced video signal reproduced from said 
second recording/reproducing device, and wherein: 

said left-eye processor 

receives the first reproduced video signal reproduced from 
.said first recording/reproducing device, the key signal generated 
by said first key signal generation means, and background video 
signal used for the background of said source video signal; 

executes first spatial image conversion to said first 
reproduced video signal and the same spatial image conversion as 
said first spatial image conversion to said key signal based on 
said spatial image conversion matrix and said left-eye perspective 
conversion matrix; and 

composites the video signal converted by said first image 
conversion means with said background video signal based on the 
key signal converted by said first image conversion means; and 

said right-eye processor 

receives the second reproduced video signal reproduced from 
said second recording/reproducing device, the key signal generated 
by said second key signal generation means, and said background 
video signal; 

executes the second spatial image conversion to said second 
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reproduced video signal and the same spatial image conversion as 
said second spatial image conversion to said key signal based on 
said spatial image conversion matrix and said right-eye 
perspective conversion matrix; and 

composites the video signal converted by said second image 
conversion means with said background video signal based on the 
key signal converted by said second image conversion means. 

13. The stereoscopic image generation apparatus according to 
claim 12 , wherein 

the key signal generated by said first key signal generation 
means is the same signal as the key signal generated by said 
second key signal generation means. 

14 . A video signal generation apparatus for generating video 
signal for visual stereoscopic effects, comprising: 

image conversion means for converting an image represented by 
source video signal to a virtual spatial position; 

left-eye video signal generation means for generating left- 
eye video signal representing an image seen through on a screen 
surface based on the virtual spatial position where there is the 
image of the converted video signal converted by said image 
conversion means and left-eye spatial position; and 

right-eye video signal generation means for generating right- 
eye video signal representing an image seen through on a screen 
surface based on the virtual spatial position where there is the 
image of said converted video signal and right-eye spatial 
position. 

15. The video signal generation apparatus according to claim 14, 
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wherein: 

said image conversion means converts said source video signal 
based on spatial image conversion matrix; 

said left-eye video signal generation means generates said 
left-eye video signal based on left-eye perspective conversion 
matrix; and 

said right-eye video signal generation means generates said 
right-eye video signal based on right-eye perspective conversion 
matrix. 

16. The video signal generation apparatus according to claim 14, 
further comprising: 

screen address generation means for generating sequential 
screen address corresponding to raster scanning, and wherein: 

said left-eye video signal generation means and said right- 
eye video signal generation means operate at the same time in 
response to said screen address. 

17. The video signal generation apparatus according to claim 15, 
wherein : 

said spatial image conversion matrix T 0 is defined as follows; 
rn ri2 ri3 0 

r21 T22 V23 0 

r3i r32 r33 0 

lx ly 1. So 

said left-eye perspective conversion matrix P L is defined as 
follows ; 



To = 
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said right-eye perspective conversion matrix P R is defined as 
follows ; 

1 0 0 0 " 
0 10 0 

Pr = 

P.Ax OOP. 
0 0 0 1 

provided that, rn to r 33 are parameters representing spatial 
rotary conversion; 

l x is a parameter representing parallel movement in the 
direction of x-axis; 

l y is a parameter representing parallel movement in the 
direction of y-axis; 

l x is a parameter representing parallel movement in the 
direction of z-axis; 

So is a parameter representing two-dimensional extension and 
reduction; and 

A x is a value showing a half of distance of a right eye and 
a left eye. 

18. The video signal generation apparatus according to claim 17, 
wherein: 

said left-eye perspective conversion matrix P L is obtained as 
follows ; 
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Pt = LP 0 L" 1 



said right-eye perspective conversion matrix P R is obtained as 
follows ; 

P R - If*LP 0 

provided that, the matrix L is defined as follows ; 

"1 0 0 0" 

0 10 0 

L ~ 0 0 1 0 

Ax 0 0 1 

the matrix L" 5 is defined as follows; 

1 0 0 0" 

0 10 0 

L = 

0 0 10 

-Ax 0 0 1 

and the matrix P 0 is defined as follows: 

0 0 " 

0 0 

1 P. 
0 1 

19. The video signal generation apparatus according to claim IB, 
wherein : 

said left-eye video signal generation means comprises 
first storing means for storing said source video signal 
temporarily; and 
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first read-out address generation means for generating read- 
out address for reading out the video signal which is calculated 
based on said spatial image conversion matrix and said left-eye 
perspective conversion matrix and is stored in said first storing 
means ; 

said right-eye video signal generation means comprises 
second storing means for storing said source video signal 
temporarily; and 

second read-out address generation means for generating read- 
out address for reading out the video signal which is calculated 
based on said spatial image conversion matrix and said right-eye 
perspective conversion matrix and is stored in said second storing 
means . 

20. The video signal generation apparatus according to claim 19, 
wherein : 

the read-out address (X^, Y^) supplied to said first storing 
means is as follows; 



X-t = — [ {-1* • r 23 • P* + r 2 2(l.P, + So) } • Xs 
Hl 



+ {ly'r^'P, + rudAt S 0 ) > Y s 
+ (-r 22 • r 13 • P s + r 12 • r„ ■ P«) ] 



Yml = — [ {1, - l.P.Ax) rasP. 
Hl 



- (r 21 -r 23 P, A x) • (l.P, + So) } X s 

+ {-<lx-lzP* A x • r 13 • P, 

+ (rn-ruP, A x) • (1,P, + S 0 > > Y s 
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+ { r 2x -r 23 P, A x) • r 13 P x 

- (ru-ruP, Ax) ' r 23 • P z } ] 

provided that, definition is done as follows; 

H t - {-r 22 (l )t -l,P I A x) + (r 21 - r 23 P x A x) • l y ) X s 
+ {r 12 (l«-l«P« A x) - (r xi - r 13 P. Ax) • l y } Y s 
+ {-r x2 * (r 21 - r 23 P x A x) + (r,.i - r 13 P x Ax)r 22 } 

the read-out address (X»r, Y,„r) supplied to said second storing 
means is as follows; 

X-r = — [ <-lx • r« • Px + r 22 (l«P» + So) } • Xs 
Hr 

+ {l y *r 13 'P x + r 12 (l x P x + So)} Y s 
+ <-r 22 • r 13 • P» + r 12 • r 23 • P.) ] 

Y-r = — [ {lx + l.PzAx) r 23 P« 
Hr 

- (r 21 + r 23 P x A x) • (1 X P X + So) } X s 
+ { - (lx + l«Px A x • r 13 • P, 

+ (r 12 + r 13 P x A x) • <1 X P X + So) > Y s 

+ {r 23 + r 23 P x A x) * r 13 P, 

- (ru + r 13 P x Ax) • r 23 • P z } ] 

provided that, definition is done as follows: 
Hr = {-r 22 dx+lxP« A x) + (r 2l + r 23 P x Ax) • l y ) X s 
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+ {r 12 (l x +l,P. Ax) - (r u + r 13 P, Ax) • l y } Y s 
+ {-r 12 9 (r 2 i+r 23 P z A x) + (ru + r 13 P x Ax)r 22 } 

and provided that, X s and Y s are screen addresses. 

21. The video signal generation apparatus according to claim 20, 
wherein 

the same screen addresses are sequentially supplied to both 
said first read-out address generation means and said second read- 
out address generation means corresponding to raster scanning. 

22. The video signal generation apparatus according to claim 19 , 
comprising: 

write-in address generation means for generating write-in 
address for writing said source video signal in said first storing 
means and said second storing means, and wherein: 

same write-in address is supplied from said write-in address 
generation means to the write-in address supplied to said first 
storing means and said second storing means. 

23. The video signal generation apparatus according to claim 15, 
wherein : 

key signal corresponding to said source video signal and 
background video signal used for the background of said source 
video signal are supplied to said left-eye video signal generation 
means and said right-eye video signal generation means ; 

said left-eye video signal generation means comprises 
first image conversion means for executing first spatial 
image conversion to said source video signal and for executing the 
same spatial image conversion as the first spatial image 
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conversion to said key signal based on said spatial image 
conversion matrix and said left-eye perspective conversion matrix; 
and 

first video signal composition means for composing the video 
signal converted by said first image conversion means with said 
background video signal based on the key signal converted by said 
first image conversion means; 

said right-eye video signal generation means comprises 
second image conversion means for executing second spatial 
image conversion to said source video signal and for executing the 
same spatial image conversion as the second spatial image 
conversion to said key signal based on said spatial image 
conversion matrix and said right -eye perspective conversion 
matrix; and 

second video signal composition means for composing the video 
signal converted by said second image conversion means with said 
background video signal based on the key signal converted by said 
second image conversion means . 

24. The video signal generation apparatus according to claim 15, 
comprising: 

first recording/reproducing device for recording output video 
signal output from said left-eye video signal generation means to 
a recording medium and for reproducing the recorded video signal 
from the recording medium; 

second recording/ reproducing device for recording output 
video signal output from said right-eye video signal generation 
means to a recording medium and for reproducing the recorded video 
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signal from the recording medium; 

first key signal generation means for generating key signal 
from the first reproduced video signal reproduced from said first 
recording/reproducing device; and 

second key signal generation means for generating key signal 
from the second reproduced video signal reproduced from said 
second recording/ reproducing device, wherein: 

said left-eye video signal generation means 

receives the first reproduced video signal reproduced from 
said first recording/reproducing device, the key signal generated 
by said first key signal generation means, and background video 
signal used for the background of said source video signal ; 

executes first spatial image conversion to said first 
reproduced video signal and the same spatial image conversion as 
said first spatial image conversion to said key signal based on 
said spatial image conversion matrix and said left-eye perspective 
conversion matrix; and 

composites the video signal, converted by said first image 
conversion means with said background video signal based on the 
key signal converted by said first image conversion means; wherein 

said right-eye processor 

receives the second reproduced video signal reproduced from 
said second recording/reproducing device, the key signal generated 
by said second key signal generation means and said background 
video signal; 

executes second spatial image conversion to said second 
reproduced video signal and the same spatial image conversion as 
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said second spatial image conversion to said key signal based on 
said spatial image conversion matrix and said right-eye 
perspective conversion matrix; and 

composites the video signal converted by said second image 
conversion means with said background video signal based on the 
key signal converted by said second image conversion means . 

25. The video signal generation apparatus according to claim 24, 
wherein 

the key signal generated by said first key signal generation 
means is the same key signal as the key signal generated by said 
second key signal generation means . 

26. A video signal generation method for generating video signal 
for obtaining the virtual stereoscopic effects, comprising: 

(a) first step of converting source video signal to virtual 
spatial position; 

(b) second step of generating left-eye video signal seen through 
on a screen surface based on the virtual spatial position of the 
converted video signal converted at said first step and spatial 
position of the left eye; and 

(c) third step of generating right-eye video signal seen through 
on a screen surface based on the virtual spatial position of the 
converted video signal converted at said first step and spatial 
position of the right eye. 

27. The video signal generation method according to claim 26, 
wherein : 

said source video signal is converted at said first step 
based on spatial image conversion matrix having parameters 
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corresponding to spatial image conversion operation which the 
operator desires; 

said left-eye video signal is generated at said second step 
based on left-eye perspective conversion matrix having parameters 
previously set by the operator; and 

said right-eye video signal is generated at said third step 
based on right-eye perspective conversion matrix having parameters 
previously set by the operator. 

28. The video signal generation method according to claim 26, 
further comprising: 

fourth step of generating sequential screen address 
corresponding to raster scanning; and wherein 

process at said first, second and th^rd steps are executed 
according to said screen address. 

29. The video signal generation method according to claim 27, 
wherein : 

said spatial image conversion matrix T 0 is defined as follows; 



To = 



rn rii ri3 0 

r21 T22 r23 0 

rai r*2 r33 0 

lx ly lx So 



said left-eye perspective conversion matrix P L is defined as 
follows ; 



Pl = 



10 0 0 
0 10 0 
-P*Ax OOP* 
0 0 0 1 
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said right-eye perspective conversion matrix P R is defined as 
follows ; 

" 1 0 0 0 " 
0 10 0 
P * = P.Ax 0 0 Px 
0 0 0 1 _ 

provided that, ru to r 3 3 are the parameters representing 
spatial rotary conversion; 

l x is the parameter representing parallel movement in the 
direction of x-axis; 

l y is the parameter representing parallel movement in the 
direction of y-axis; 

l z is the parameter representing parallel movement in the 
direction of z-axis; 

So is the parameter representing two-dimensional extension and 
reduction; 

P z is the perspective value previously set; and 
A x is the value representing a half of distance between the 
right-eye and left-eye . 

30. The video signal generation apparatus according to claim 29, 
wherein : 

said left-eye perspective conversion matrix P^ is obtained as 
follows ; 

Pl = LP 0 I/ 1 

said right-eye perspective conversion matrix P R is obtained as 
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follows ; 



P R = L" 1 LP 0 

provided that, the matrix L is defined as follows; 

'1 0 0 0" 
0 10 0 

L = 

0 0 10 
Ax 0 0 1 

the matrix If 1 is defined as follows; 

1 0 0 0" 

x 0 10 0 

L 0 0 10 

-Ax 0 0 1 

and the matrix P 0 is defined as follows; 

0 0 0" 
10 0 
0 1 P« 
0 0 1 

31. The video signal generation method according to claim 30, 
comprising: 

fifth step of temporarily storing said source video signal to 
first storing means and second storing means; 

sixth step of generating left-eye read-out address for 
reading out the video signal stored in said first storing means 
based on said spatial image conversion matrix and said left-eye 
perspective conversion matrix; and 
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seventh step of generating right-eye read-out address for 
reading out the video signal stored in said second storing means 
based on said spatial image conversion matrix and said right-eye 
perspective conversion matrix. 

32. The video signal generation method according to claim 31, 
wherein : 

said left-eye read-out address {X*l, Y^) are; 

X*l = — [ {-1* • r 2 3 • Px + r«(l«Px + So) } • Xs 
Hi 

+ {l y -r 13 'P* + r 12 (l 2 P z + So)} Y s 
+ (-r 22 • r 13 • Pz + r 12 • r 23 • P s ) ] 

Y-l. = — [ {lx - lxPxAx) r 23 Px 
Hl 

- <r 21 -r 23 P* A x) • (1 2 P Z + So) } X s 
+ {-Ux-lzP* Ax • r 13 • P, 

+ (rn-r^ A x) • (l,P a + S 0 ) } Y s 

+ {r 21 -r 23 P x A x) • r 13 P z 

- (rn-riaP, Ax) • r 23 • P 2 } ] 

provided that; 

H t - {-r 22 (l x -l x P x A x) + (r 12 - r 23 P x Ax) • l y ) X s 
+ {r 12 (lx-lxPx A x) - (r lx - r 13 P x Ax) • l y ) Y s 
+ {~r 12 - (r 21 -r 23 P z A x) + (m - r 13 P z Ax)r 22 } 

said right-eye read-out address (Xn*, Y^) are as follows; 
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— [ {-1* • r 23 • P* + r 2 2(lxPx + So) } • Xs 
Hr 

+ {l y -r 13 -P z + r X2 (l 2 P z + So)} Y s 
+ (-r 22 * r 13 • P z + r 12 • r 23 • P z ) ] 

— [ {1* + lxPxAx) r 2 3Px 

Hr 

- (r 21 + r 23 P z A x) • <1 Z P Z + So) > X s 
+ {-(1* + lxP* A x • r 13 • P z - 
+ (r L1 + r 13 P z A x) • <1 Z P Z + So) } Y s 
+ {r 21 + r 23 P z A x) ■ r 13 P z 

- (r xl + r 13 P z Ax) • r 23 • P z } ] 

provided that, it Is defined as follcvs; 

H R = { -r 22 (1 X +1 Z P Z A x) + (r 21 + r 23 P z Ax) • l y ) X s 
+ {r 12 (lx+lzPz A x) - (r xx + r i3 P z A x) • l y } Y s 
+ {-r 12 - (r 21 +r 23 P z A x) + (r« + r 13 P z Ax)r 22 } 

and, X s and Y s are screen addresses corresponding to the 
raster scanning. 

33. A video signal generation method for generating video signal 
for obtaining virtual stereoscopic effects, comprising: 

(a) first step of receiving source video signal, source key- 
signal corresponding to said source video signal, and background 
video signal used for the background of said source video signal; 

(b) second step of converting said source video signal and said 
source key signal to virtual spatial position; 



X-R = 



Y-R = 
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(c) third step of generating left-eye video signal and left-eye 
key signal seen through on a screen surface based on virtual 
spatial positions of the converted video signal and the converted 
key signal both converted at said second step and the spatial 
position of the left eye; 

(d) fourth step of composing said left-eye video signal and said 
background video signal based on said left-eye key signal; 

(e) fifth step of generating right-eye video signal and right-eye 
key signal seen through on a screen surface based on virtual 
spatial positions of the converted video signal and the converted 
key signal both converted at said second step and the spatial 
position of the right eye; and 

(f) sixth step of composing said right-eye video signal and said 
background video signal based on said right-eye key signal . 

34 . A video signal generation system for generating video signal 
for obtaining virtual stereoscopic effects, comprising: 

(a) first step of converting source video signal to virtual 
spatial position: 

(b) second step of generating left-eye video signal seen through 
on a screen surface based on the virtual spatial position of the 
converted video signal converted at said first step and the 
spatial position of the left eye; 

(c) third step of generating right-eye video signal seen through 
on a screen surface based on the virtual spatial position of the 
converted video signal converted at said first step and the 
spatial position of the right eye; and 

(d) fourth step of displaying said left-eye video signal and said 
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right-eye video signal on the screen surface at the same time. 
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